Predicting Low vs. High Disparity between Peer and Expert Ratings in Peer Reviews of Physics Lab Reports
نویسندگان
چکیده
Our interest in this work is to automatically predict whether peer ratings have high or low agreement in terms of disparity with instructor ratings, using solely features extracted from quantitative peer ratings and text-based peer comments. Experimental results suggest that our model can indeed outperform a majority baseline in predicting low versus high rating disparity. Furthermore, the reliability of both peer ratings and comments (in terms of peer disagreement) shows little correlation to disparity.
منابع مشابه
Self – Others Rating Discrepancy of Task and Contextual Performance
This research compared ratings of task performance and contextual performance from three different sources: self, peer, and supervisor. Participants were service industry employees in the service industries in Yogyakarta, Indonesia. A Sample of 146 employees and 40 supervisors from the service industries provided ratings of task performance and contextual performance. The results indicated th...
متن کاملRater Errors among Peer-Assessors: Applying the Many-Facet Rasch Measurement Model
In this study, the researcher used the many-facet Rasch measurement model (MFRM) to detect two pervasive rater errors among peer-assessors rating EFL essays. The researcher also compared the ratings of peer-assessors to those of teacher assessors to gain a clearer understanding of the ratings of peer-assessors. To that end, the researcher used a fully crossed design in which all peer-assessors ...
متن کاملTHREE TYPES OF COMMENTS ON CONTENT: TEACHER VS. PEER FEEDBACK
This study was conducted to examine the effect of three types of comments, i.e. imperatives, questions, and statements, with different communicative purposes, i.e. giving information and making a request, given by an ELT teacher and peers on students’ revision of their writings. Sixty-four female students, between 16 and 26 years old studying at high-intermediate level of English language prof...
متن کاملTeacher-Assisted vs. Peer-Assisted Performances and L2 Development: A Mixed Methods Approach
The present study compared the impact of teacher-provided and peer-provided oral assistance in the acquisition of English wh-question forms. Participants were 90 female Iranian EFL learners who constituted the 3 groups of the study: teacherassisted, peer-assisted, and a control group. Participants in the experimental groups received assistance either from the teacher or a peer during task-based...
متن کاملIranian EFL Learners’ Reactions to Different Feedbacks in Writing Classrooms: Teacher Written Comments (TWC) vs. Peer Written Comments (PWC)
The teaching of writing has recently begun to move away from a concentration on the written product to an emphasis on the process of writing. Feedback is a fundamental element of the process approach to writing. It can be defined as input from a reader to a writer with the effect of providing information to the writer for a revision. This study reports on the effectiveness of two types of feedb...
متن کامل